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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to Amendment filed 1 1/16/09 . 
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a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 
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International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 

Response to Amendment 

1 . In response to the Office Action mailed 9/23/09, applicant has submitted an 
amendment filed 11/16/09. 

Claims 1, 8, 11, 12, 19, 22-24, 27, 34, 36, have been amended. 

Allowable Subject Matter 

1. Claims 1, 6-9, 11-14, 16-29, 33-34, and 36-38, are allowed. 

2. The following is an examiner's statement of reasons for allowance: 

The prior art of record generally teaches the different functions independent 
claims 1,19, and 27, but does not teach the specific distribution of the functions 
between the SALT module and VoiceXML module and the interaction between the 
SALT module and VoiceXML module. 

Williams et al. (US 2003/0212561) teaches programming IVR systems using both 
VXML/VoiceXML and SALT (paragraph 15). 

As stated by applicant, Williams only mentions that VoiceXML and SALT are 
programming languages used in IVR systems (Amendment, page 10) 

As per Claim 1 , since Williams only generally teaches where VoiceXML and 
SALT are used in an IVR system ("computer to process information"), Williams does not 
teach or reasonably suggest that the VoiceXML module declares a first field and a 
second field and where the SALT module obtains a recognition result from an initialized 
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recognition event with a plurality of associated grammars and associates a first portion 
of a recognition RESULT with a first grammar of the plurality of grammars to complete 
the first field declared by the VoiceXML module and associates a second portion of the 
recognition RESULT with a second grammar of the plurality of grammars to complete 
the second field . 

Williams teaches using VoiceXML and SALT to implement a dialog with a 
corresponding call flow ("branching voice queries... caller responds with button 
pushes... or voice responses", paragraph 5; "call flow", paragraphs 10-11; "call flow", 
paragraphs 73-76; where dialog systems usually involve a window for listening to the 
user's response after a particular prompt is played to the user). Dialogs conducted with 
users necessarily include obtaining a recognition result from a speech recognition 
process (event) in order to determine exactly what the user is saying and to process the 
input properly. A dialog and call flow also necessarily has a sequence of prompts that 
the machine/IVR uses to communicate with the user. Since the prompts are delivered 
in a sequence, there is something in the VXML/SALT information that determines the 
order of outputting the prompts, in addition to telling the system to recognize speech 
and perform other functions. 

Therefore, Williams teaches/suggests, by teaching a VXML/SALT IVR system, a 
VoiceXML module executing form interpretation and establishing an interactive dialogue 
with a user including instructions associated with dialog events including 
recognition/prompting/messaging which are executed in a defined order and since the 
system decides which prompt to present after a particular event without interference 
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from a user , it automatically advances from one instruction to another instruction in a 
defined order. Williams also teaches/suggests a SALT module including temporal 
triggers. Applicant defines in the Specification that a "temporal trigger" "may include 
various events such as an error, exception, receipt of a message, recognition and/or no 
recognition or combinations thereof (page 6, lines 13-25) and "may be triggered using 
a listen tag that includes one or more grammar elements" (page 24, lines 7-28). 
Therefore, by teaching a dialogue with a call flow which includes prompts being output 
to the user to obtain user speech, and recognizing user speech (e.g., Williams, Figure 
7), Williams teaches temporal triggers that initialize speech recognition events that 
obtain recognition results. Williams suggests the portions of the claimed SALT module 
because, in an IVR system that uses VXML and/or SALT, the designer of the markup 
language document could opt to encode a portion of the functions using SALT and 
another portion using VXML. 

Williams, however, fails to teach declaring first and second fields and distributing 
the portions of the recognition result to the first and second fields by associating the 
portions of the recognition RESULT with the GRAMMARS belonging to the first and 
second fields (i.e., a first grammar for the first field and a second grammar for a second 
field). 

Aust et al. (US 5,860,059) teaches associating portions of a recognition result 
with a corresponding field (Figures 2A-2P; col. 3, lines 26-54; e.g., the system parses 
the user's answer to the question "from where to where do you want to travel" to fill a 
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date field and a departure location [two distinct fields] with the different parts of "today 
from Aachen"). 

Aust, however, does not teach where matching the recognition result with the 
field is done by associating the result with a grammar of the field. In Aust, the 
recognition result is directly associated with the field without involving the grammars, 
since the grammars were already used to obtain the recognition result (i.e., the speech 
is associated with the grammar to produce the result but the result is not associated 
with a grammar for a field). 

Gong et al. (US 2004/0006474) teaches (Figures 17, 21, and 25, paragraph 245; 
paragraph 251 ) describes a VXML interface including a city grammar, a state grammar 
and a street grammar (paragraph 251 ). Since each of the city/state/street grammars 
can include Washington (Washington St./Washington DC/Washington state), this 
suggests that the system should associate an input of Washington with a particular 
grammar to determine if it is a city, a state, or a street. 

However, Gong resolves this by making only one grammar active at a given time 
(paragraphs 255-256). Since the recognition result is obtained from a particular 
grammar, there is no need to associate the result with the grammar . 

Even associating the recognition result with the grammar is obvious, the prior art 
of record does not specifically teach that the SALT portion of a markup language 
document, particularly, accomplishes these steps. Williams suggests that the feature 
could be implemented in SALT but there is no apparent reason for one of ordinary skill 
in the art to do so without employing impermissible hindsight (Amendment, page 10) 
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Therefore, the prior art of record does not teach associating portions of the 
recognition result with a particular grammar to complete one of the fields declared by 
the VoiceXML module , where this association, along with the other claimed functions of 
the SALT module, is performed by the SALT module , in combination with the remaining 
limitations in Claim 1 (including the assigned tasks of the VoiceXML module). 

As per Claim 19, Williams and Aust teach/suggest performing speech recognition 
events, prompting events, etc., in a dialog to fill declared fields using a VXML/SALT IVR 
system, where voice markup language documents are processed in the order that the 
instructions in the document are written in to produce the dialog, which includes 
recognition and prompting, as discussed above regarding Claim 1 . The inherent 
features of processing voice markup language documents involve automatically 
advancing/moving through an ordered list of instructions and performing functions 
based on the markup language tags and other command strings in the voice markup 
language document, which are claimed in Claim 1 . 

Aust further suggests looping through the VoiceXML executable instructions in a 
defined order until the first and second VoiceXML field shave been filled by the user 
because Aust teaches continuously prompting for missing information depending on 
what the user says and what the system still needs to know to complete a transaction 
(i.e., ask for the missing destination, time, etc.) (Figures 2A-2P; col. 3, lines 26-54). 

Taylor (US 6,922,411) teaches looping through VXML instructions (col. 16-17. 
Table 6A; especially col. 17, "a looping structure so that vxml elements can be repeated 
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...before tinning out") in order to ensure input (i.e., ensure that a field is filled) where the 
field in Taylor is whatever memory location is used to contain the user's speech. The 
loop also for controlling prompting events because Taylor teaches playing an audio 
prompt X times. 

Loops and interrupts in programmed source codes are also well-known in the art. 
It is also well-known that markup language parsers read through markup language 
documents in some form of sequence and encounter markup language tags and 
perform a function associated with an encountered tag (e.g., performing some sort of 
display in response to detecting an <HTML> tag). The interrupting of a loop through a 
markup language document and automatically advancing/moving to a subsequent 
instruction in a defined order is not new and/or is obvious. 

The prior art of record, however, does not teach/suggest that the SALT module 
specifically handles the speech recognition events while the VoiceXML module handles 
the prompting events and declares VoiceXML fields (instead of, for example, having the 
SALT tags declare fields or using some other markup language to declare fields). Even 
though one of ordinary skill in the art could design a voice markup language document 
using a combination of SALT and VoiceXML/VXML (where Williams teaches combining 
SALT and VoiceXML in a voice markup language system), there is no apparent reason 
for one of ordinary skill in the art to require the SALT and VoiceXML modules to perform 
their respective functions as defined in Claim 19 without employing impermissible 
hindsight (Amendment, page 10). Applicant's claim 19 is a species and/or an element 
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of the broader genus of SALTA/XML documents described in Williams because it 
specifically defines the functions performed by the SALT module and the VXML module. 

As per Claim 27, Williams and Aust, as discussed above, teach/suggest the use 
of voice markup language documents with SALT and VoiceXML, which contain 
sequentially ordered operations/instructions for conducting a dialog (including 
recognition and prompting), and also where the dialog fills in fields corresponding to 
inputs. 

Zou et al. (US 6,246,983) further teaches multi-modal inputs using DTMF and 
voice (col. 3, line 51 - col. 4, line 3). 

Chaves (US 6,51 0,41 4) teaches where the grammar of the recognition system 
can recognize both DTMF signals and speech (col. 4, line 65 - col. 5, line 10) which 
implies that an input can include both DTMF signals and speech 

Chang et al. (US 2003/0149565) teaches parsing an input which can include 
DTMF signals and/or spoken sounds (paragraph 9) in the context of a location system 
("Mapquest server", paragraph 155) which implies a set of fields such as ZIP codes, 
street names, city names, etc. (paragraphs 153-154). This suggests dividing/parsing a 
DTMF/Speech combination input including a DTMF ZIP code and spoken street/city 
name to fill a city/street and ZIP code field because there is less risk of erroneous 
recognition to enter a ZIP code manually and it is much more tedious to enter a 
city/street name by hand as opposed to speaking it. It also logically follows that the 
system would fill a ZIP code field with a DTMF ZIP code and the city/street name field 
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with a spoken city/street name because to do anything else would constitute an error 
(i.e., the different components of the input are put where they are supposed to be). 

Brotman et al. (US 2001/0049599) teaches where ZIP codes and other 
numerical data are entered using DTMF codes (paragraph 10). 

However, similar to the reasoning discussed above regarding claims 1 and 19, 
the prior art of record does not teach or reasonably suggest where associating a spoken 
portion of an input with one field, and where a DTMF portion of an input is associated 
with a second field, is performed by a SALT module , where the fields are declared by 
the VoiceXML module , and where the SALT and VoiceXML modules perform the other 
functions assigned to them in Claim 27. 

Even though one of ordinary skill in the art could design a voice markup 
language document using a combination of SALT and VoiceXML/VXML (where Williams 
teaches combining SALT and VoiceXML in a voice markup language system), there is 
no apparent reason for one of ordinary skill in the art to do so without employing 
impermissible hindsight (Amendment, page 10) 

In summary, the actual method steps of claims 1,19, and 27, are not new or non- 
obvious but the prior art of record does not teach or suggest the combinations where 
these method steps are distributed between the SALT module and VoiceXML module in 
the manner defined in Claims 1,19, and 27. 
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Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ERIC YEN whose telephone number is (571)272-4249. 
The examiner can normally be reached on M-F 7:30-4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on 571-272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571 - 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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